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Method of Intruder Detection and Device Thereof 

BACKGRO UND OF THE INVENTION 
5 (a) Field of the Invention 

The present invention relates to the security systems and, in particular, it 
concerns a system that observes the surveillance zone with stereo camera and 
analyses if there is an intruder or not in the area 
(b) Description of the Related Art 

10 The modern level of technology makes it possible to develop intellectual 

security systems to make business and private life more safe and convenient. Intruder 
detector is an automatic system that detects intrusion of any human body into 
surveillance zone. Surveillance zone is the area that must be protected with intruder 
detector, including offices, banks, private homes or any other buildings, any area that is 

15 not the open space. Since last years different technical solutions have been proposed 

for this area. 

One example of an attempt to make a solution of this problem is the intruder 
detection system disclosed in U.S. Pat. No. 5,910,767. In this method the light beam 
from laser scans the surveillance zone and reflects from the target that might be the 

20 potential intruder and computer measures and analyzes the distance and intensity of 
the reflected light and sounds an alarm if detected person is an intruder. However, this 
method has several serious disadvantages. First, it uses intermediate optics (mirror, 
equipment for its rotation and so on) that can give a substantial part of error in 
intruder's detection and additional noise to the input scene. Indeed, usage of laser can 

25 occupy additional time to scan the surveillance area to receive data about all points of 

the scene and there are limits in spectral range based on chosen type of laser. 
Furthermore, price of some types of lasers can be very high and the spectral range can 
be not appropriate to work both under dark and with daylight illumination. Thus, the 
method of U.S. Pat. No. 5,910,767 is highly limited in potential applications. 

30 Similarly, U.S. Pat. No. 4,364,030 discloses another intruder detection system. 

This system includes infrared sensor, optical system and electronic system for 
processing of image data. However, because of infrared sensor usage the level of false 
alarm for this system is much higher because of the reaction of sensor on the heat 
flows that can be not only from the human intruder. 
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Another example is disclosed in Pat. of Russian Federation No. 95115528/09. 
This method involves two-stage recognition. First stage includes matching personal 
code of person and password which he/she utters. Then device for scanning face 
according to person's height is loaded and face image is scanned and compared to 
5 stored data. If there is a correspondence between these characteristics the system 
detects the object. This system is the system of protection of the entering of 
surveillance zone from unauthorized access. However, this method has several big 
disadvantages. First, this method is non convenient for authorized user because he 
needs to remember the input data and to do something to enter the area. Also, this 
10 method permits only the entrance of the intruder but it cannot monitor the whole 
surveillance zone if there is an intruder. So because of those disadvantages it has 
serious limits in potential applications. 

In general, there are a lot of different methods in the field of intruder's 
detection using different kinds of sensors and computer or processor for sensor's 
15 signal processing. 

However, such a limitation implies to develop method that have both low price 
of the equipment and low level of false alarms and noise in input images. Such system 
can detect intruder more efficiently using stereo camera for observing the surveillance 
zone and special digital signal processor for images processing with high speed and 
20 good quality. 

SUMMARY OF THE INVENTION 

The present invention is of a method for detecting of the presence of intruder 
in the surveillance zone. Methods are disclosed for high performance intrusion 

25 detection by using of sensor for obtaining images to transmit image data to the 
processor to calculate optical flows for detection of moving intruders and 3D 
reconstruction for detection of static intruders combining with noise filtering. The 
sensor is, for example, stereo camera, that obtains and transmits image data to the 
processor. This processor is, for example, a digital signal processor, that performs 

30 analyzing and processing of image data that is transmitted from stereo camera. The 
disclosed method that consists in: 

Using of at least 2 identical sensors, for example, video cameras, that are 
spatially carried with predetermined spatial orientation that are further called stereo camera. 
The 2D spatial distributions of light intensity from stereo cameras that are further called 
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stereo images are periodically transferred to the processors, for example, digital signal 
processors, both with for high or low frequencies; 

With high frequency - for detection of fast moving intruders, 

Low frequency - for detection of slow moving intruders. 
5 The processors, for example, digital signal processors, perform the detection 

of intruders and create the output signal if the intruder is detected. The output signal is 
transferred to the output device, for example, the alarm signaling device. 

The detection of fast moving intruder is performed in fast motion detection 
processor, for example, digital signal processor, by comparing sequences of stereo images 
l o with high frequency. 

The detection of slow moving intruder is performed by slow motion detection 
processor by comparing current 3D depth distribution to the preliminary stored one. 

Stereo images are processed both individually and in combination in order to 
distinguish intruder from shadows, flashes etc., i.e. if intruder is detected by fast motion 
15 detection processor, the detection should be confirmed by slow motion detection processor. 

That there is carried out the comparison of 2 or more subsequent stereo images 
and is determined the measure of their difference, for example, by forming the 2D field of 
velocities, by fast motion detection processor. 

In the case if the measure of difference found by fast motion detection processor is 
20 more than a predetermined value an area where such difference exists is remembered. 

That there is analyzed the spatial distribution of determined measures of difference 
for each of stereo images by fast motion detection processor. 

There is carried out comparison of marked changes on two or more stereo images 
by fast motion detection processor. By means of using of predetermined information about 
25 relative special position of stereo images, there is determined spatial location, geometrical 

size and distance to the possible intruder that is stimulated by above mentioned change of 
signal. 

By means of comparison of 2D fields of velocities, as stated in claim 5, with 
predetermined showings there is determined whether given object can be intruder. The 
30 intruder is a human that enters the surveillance zone independently of its age, height, 

weight, sex, and position (whole intruder, lying or sitting intruder and so on). 

In the case of positive determination of the intruder there is carried out more 
detailed measurement of object's elements location in space by means of finding of 
correspondent points on stereo images by slow motion detection processor that are 
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obtained from 2 or more stereo images. 

There is determined the 3D object's elements location in space by means of 
finding of correspondent points whereupon this location is compared with predetermined 
3D distribution of background's elements for distinguishing of intruder from shadows, 
5 flashlights and headlights. 

In the case if above mentioned difference of possible intruder's and background's 
location is more than some predetermined value there is generated an alarm signal that 
denotes the intruder's appearance. 

If during the predetermined period of time there was no detection of fast moving 
10 intruder after a lapse of time there is carried out detailed determination of 3D element's 
disposition in the limits of the view field by slow motion detection processor and comparison 
with the background's distribution that was remembered in advance. It is necessary for 
detection of the intruder that is moving enough slow and that is not detected by means of 
realization of above mentioned operations because the difference between successive 
15 stereo images is insignificant. 

There is carried out the comparison of the measured 3D distribution of elements 
with predetermined 3D background's distribution, in the case if this difference is more than 
some predetermined value there is determined the geometrical size and the possible 
intruder's shape in the zone of exposed changes. 
20 These characteristics are compared with characteristics that are known in advance 

and in the case of correspondence of these characteristics to the possible characteristics of 
intruder there is generated an alarm signal about the possible presence of intruder. 

Before the beginning of the area tracking by means of above mentioned 
operations there is carried out the measurement of scene's elements distribution in the 
25 surveillance zone by means of remembering of predetermined number of stereo images if 

there is no intruder and based on it measurement of elements of 3D distribution and 
averaging-out. 

Before the beginning of the area tracking by means of above mentioned 
operations there is carried out the calibration of 2 or more sensors that consists in 
30 presentation of the object with known geometrical characteristics, carrying out 

measurements of those its characteristics, comparing with predetermined and insertion of 
corrections that are compensating errors in carried measurements. Such operation should 
be performed before carrying out of measurements in the case of change of geometrical 
relative special position of sensors or substitution of at least one of sensors. 
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Usage of such method for detection of objects in stereo images is important 
for a number of reasons. First, by comparing points on left and right stereo images the 
processor, for example, digital signal processor, improves the work of method because 
it can reject the false points that might be found on one of stereo images in case of 
5 using of mono detector and correspondingly increases the SNR (signal to noise ratio) 

and decreases the level of false alarms. 

Another reason why usage of such method is important is that there are two 
different methods for detection of intruder that are combined into one. The detection of 
moving intruder is performed by the processor, for example, digital signal processor, by 

10 calculation of optical flows - the speed of every point of object if it is moving. Such kind 
of detection is performed with very high speed. If the intruder is not moving in the 
surveillance zone, the processor, for example, digital signal processor performs 3D 
reconstruction of static object to detect intruder. Processor, for example, digital signal 
processor, creates a map of points from stereo images that have a correspondence 

15 between each other. The disparity is calculated as a distance difference between 

corresponding points. Calculation of disparity makes it possible to determine the 
distance between appropriate camera (left and right) and the point on 3D object (static 
intruder). This detection requires lots of calculation resources and because of that it is 
performed with slow speed. The processor, for example, digital signal processor, 

20 performs this combined method that contains these two parts and realizes fast 
detection of moving intruder method every time and slow static intruder detection 
method at each test time (for example, 3 seconds). Because of that the total speed of 
combined method is high and stereo intruder detector can observe the surveillance 
zone for detection of intruder very fast. 

25 One more reason why this method is important is the possibility for stereo 

intruder detector to observe the lengthy area and process all points in it for a short time. 
It is possible because it consists of stereo camera that can observe such area and of 
high speed processor, for example, digital signal processor, to make processing. 

Finally, in preferred embodiments of the present invention, stereo intruder 

30 detector's precision of intruder's detection is very high because of the processor, for 
example, digital signal processor, that performs the adjustment that performs 
compensation of the distortions of right and left lenses of the device, for example, 
stereo camera, and by that improves the precision. 

Hereinafter, the term "video stream" is defined as sequence of 2D images that 
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are following one after another with determined speed and order. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and constitute a part 
5 of the specification, illustrate an embodiment of the invention, and, together with the 
description, serve to explain the principles of the invention: 

FIG 1 illustrates an example of Stereo Intruder Detector's displacement in the 
surveillance zone; 

FIG 2 illustrates an example of stereo intruder detector; 
10 FIG 3 illustrates an example of the SID method; and 

FIG. 4 illustrates one example of stereo camera. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the following detailed description, only the preferred embodiment of the 
15 invention has been shown and described, simply by way of illustration of the best mode 

contemplated by the inventor(s) of carrying out the invention. As will be realized, the 
invention is capable of modification in various obvious respects, all without departing 
from the invention. Accordingly, the drawings and description are to be regarded as 
illustrative in nature, and not restrictive. 
20 The invention is herein described, by way of example only, with reference to 

the accompanying drawings, wherein: 

FIG 1 illustrates an example of Stereo Intruder Detector's displacement in the 
surveillance zone. 

The present invention is of stereo intruder detector that performs the detection of 
25 intruders that entering the surveillance zone. The example of system's displacement is 

presented on FIG 1. According to FIG 1 stereo intruder detector takes up the position near 
the ceiling of the enclosed space at the height up to 2.5 m and performs the detection of 
intruder in the surveillance zone that has geometrical size up to 5x 10 m. 
FIG 2 illustrates an example of stereo intruder detector. 
30 Stereo intruder detector consists of several parts: (a) the device, for example, 

a stereo camera, and (b) processors. Processors, for example, digital signal 
processors, are performing analysis and processing of transmitted stereo images from 
the device, for example, stereo camera. This processing contains different transforms 
that processors, for example, digital signal processors, are performing with transmitted 
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signal. 

According to the embodiments of the present invention that are presented on 
FIG. 2, processors, for example, digital signal processors, contain several blocks of 
processing, that differs from other stereo intruder detection systems and contain: (a) 
5 Dynamic Preprocessor; (b) Moving objects detector; (c) Dynamic Decision Performer; 

(d) Static Preprocessor; (e) Reconstructor of 3D scene; (f) Detector of 3D objects; (g) 
Static Decision Performer; (h) 3D Calibrator; (i) Control Panel; (j) Output alarm signal 
creator. 

According to scheme on FIG 2, the moving intruder detection (yellow blocks) 
10 is performed by fast motion detection processor, for example, digital signal processor. 

The static intruder detection (blue blocks) is performed by slow motion detection 
processor for example, digital signal processor. 

FIG 3 illustrates an example of the SID method. 

Stereo intruder detector realizes the method of real time intruder detection. 

15 Based on the embodiments of the present invention stereo intruder detector consists of 

the sensor, for example, stereo camera and processors, for example, digital signal 
processors. Stereo intruder detector is putted in the surveillance zone according to 
above mentioned scheme that is presented on FIG 1. The sensor, for example, stereo 
camera, observes the surveillance zone and creates and transmits stereo images to 

20 processors, for example, digital signal processors. Processors, for example, digital 

signal processors are performing processing of the transmitted signal according to the 
above mentioned scheme that is presented on FIG 2. 

In fact, this method consists in the observing of the surveillance zone by the 
sensor, for example, stereo camera and the work that processors, for example, digital 

25 signal processors, are performing with the transmitted signal. This work consists in 

above mentioned blocks of processing that are presented in FIG 2. In fact, according to 
the embodiments of the present invention, processors, for example, digital signal 
processors are performing these above mentioned blocks of processing. 

The example of such kind of transforms that are performed by processors, for 

30 example, digital signal processors, is presented on FIG. 3. 

According to FIG 3, there is presented an explanation of example of 
processing that processors, for example, digital signal processors, are performing with 
the transmitted signal. Processors, for example, digital signal processors, are 
performing the processing of the above mentioned transmitted signal that consists in: 
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(a) Receiving of transmitted stereo images from the sensor and preparing of it 
for processing. 

(b) Preparing that consists in the preprocessing of these stereo images by 
performance of receiving of data about camera's lenses distortion and optical axes 

5 displacement and calculation of all control parameters of the device. 

(c) Detecting of moving objects after correction of stereo images in compliance 
with the data of preprocessing. The detection of moving objects is performed by 2D 
field of velocities calculation that consists in calculation of the speed of every point of 
object if it is moving. 

10 (d) The decision making & classification for moving objects by performing that 

fast motion detection processor, gives an answer if detected object is intruder or not. If 
it answers that this object is an intruder, it stores the stereo images with detected 
intruder to memory and creates an alarm signal (to be explained later). If it answers 
that this object is not an intruder, it performs checking of time if the test time has 

15 passed or not. If it has not passed, fast motion detection processor repeats the 

processing. 

(e) Detecting of static objects in the surveillance zone. The detection of static 
objects is performed by slow motion detection processor by means of the 3D 
reconstruction of the scene that consists in creation of a map of points from the stereo 

20 images that have a correspondence between each other. The fact of the presence of 

such correspondence is found using calculation of disparity. Disparity is the distance 
between appropriate camera (left or right) and the point on 3D object (static intruder). 

(f) The decision making & classification for static objects by performing that 
slow motion detection processor gives an answer if detected object is intruder or not. If 

25 it answers that detected object is an intruder, it stores stereo images with detected 

intruder to memory and creates an alarm signal (to be explained later). If it answers 
that this object is not an intruder, it repeats the processing. 

(g) Storage of sequences of stereo images that have the detected intruder 
occlusions to memory. The total number of stereo images for each sequence is at least 

30 10. This number contains 2 pre-images (before entrance of surveillance zone by 

intruder), 1 detected stereo image with entering intruder and 7 post-images (after 
detection). 

(h) Performance of the output alarm signal if moving or static intruder is 
detected. Processors create the alarm signal and transmit it to the output device that 
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reproduces it. 

FIG 4 illustrates one example of stereo camera. 

The device presented at FIG 4 is, for example, a stereo camera, that contains 
two video cameras, infrared illuminator, for example, light emitting diodes (LED) array, 
5 and 2D matrix of photo detectors, for example, CMOS sensor. These video cameras 
are observing the surveillance zone and creating stereo images that are converted into 
NTSC signals by 2D matrix of photo detectors, for example, CMOS sensor, and 
merged into one and transmitted to the processors, for example, digital signal 
processors. Infrared illuminator, for example, LED array, is performing the illumination 

10 of the surveillance zone to obtain high quality stereo images by the device, for example, 
stereo camera, if the illumination conditions don't have enough light. 

The industrial applicability of stereo intruder detector can be various because 
of its properties and design. Today's high level of demands of security gives a 
possibility to use the SID in the area of protection of offices, banks, shops, private 

15 houses, industrial buildings and other enclosed space areas from intrusion. 

While this invention has been described in connection with what is presently 
considered to be the most practical and preferred embodiment, it is to be understood 
that the invention is not limited to the disclosed embodiments, but, on the contrary, is 
intended to cover various modifications and equivalent arrangements included within 

20 the spirit and scope of the appended claims. 

Stereo intruder detector is a system for detection of intruder in the surveillance 
zone. The detector includes the sensor, for example, stereo camera, the processor, for 
example, digital signal processor and software for intruder's detection. The device, for 
example, stereo camera, observes the surveillance zone and video streams are 

25 processed by the processor, for example, digital signal processor. To work under dark 

environment the system includes the illuminator, for example, LED array. The system 
works in real time scale. The algorithm for detecting of intruder is based on two parts: 
moving intruder detection and static intruder detection. Also it includes parts of the 
calibration of the sensor, for example, stereo camera, to correct the lenses distortion 

30 and decision making subsystem to make a conclusion if the detected object is intruder 

or not. If intruder is detected, an alarm is sounded and the result is saved to memory. 

As described in Prior Art Analysis, most of intruder detection systems have 
serious limits in usage, low performance of processing, and narrow spectral bandwidth. 
In contrast to these systems our stereo intruder detector satisfies next conditions: (a) it 
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has various possibilities of usage; (b) it performs processing with high performance for 
work in real time scale; (c) it has wide spectral bandwidth for work in different 
conditions of illumination. 

Thus, usage of stereo intruder detector described above results in wide 
possibilities of usage of mentioned above system in various conditions because of 
small geometrical size and possibilities to put in any place of surveillance zone. 

Thus, usage of stereo intruder detector that consists of stereo camera that can 
observe the surveillance zone and can create image data from all points of its view field 
simultaneously, and that consists of digital signal processor that can perform 
processing of the transmitted image data created by stereo camera with high 
performance results in working of mentioned above system in real time. 

Same, usage of stereo intruder detector that consists of digital signal 
processor that performs a correction of errors of image signal and that consists of 
stereo camera that is transmitting this image signal results in high performance and 
improvement of noise filtering. 

Thus, usage of stereo intruder detector that consists of stereo camera that can 
create image data from the surveillance zone and that consists of light emitting diodes 
array that can illuminate the surveillance zone if there are not enough light in it results 
in possibilities of its usage in any conditions of illumination that is correspondent to the 
wide spectral bandwidth. 

So stereo intruder detector is a high performance device that can detect 
presence of intruder in the surveillance zone with high speed and low false detection 
rate in a real time scale at any illumination conditions. 
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